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In systems which exhibit deterministic diffusion, the gross parameter dependence of the diffusion coefficient 
can often be understood in terms of random walk models. Provided the decay of correlations is fast enough, 
one can ignore memory effects and approximate the diffusion coefficient according to dimensional arguments. 
By successively including the effects of one and two steps of memory on this approximation, we examine the 
effects of "persistence" on the diffusion coefficients of extended two-dimensional billiard tables and show how 
to properly account for these effects, using walks in which a particle undergoes jumps in different directions 
with probabilities that depend on where they came from. 
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I. INTRODUCTION 

Diffusion is a fundamental macroscopic phenomenon in 
physical systems, which, for instance, characterizes the 
spreading of tracer particles in a solvent. At a mescoscopic 
scale, it can be traced to the cumulative effect of many "ran- 
dom" displacements, as in Brownian motion fl]. At the under- 
lying microscopic scale, however, the dynamics of a system 
are deterministic. Deterministic diffusion concerns the study 
of microscopic models whose deterministic dynamics also ex- 
hibit diffusive behavior at a macroscopic scale |l2][3]|4l. 

A particularly appealing, physically motivated model 
which does exhibit this phenomenon is the periodic Lorentz 
gas |5|. Here, independent point particles in free motion un- 
dergo elastic collisions with fixed hard disks in a periodic ar- 
ray. The diffusive motion can then be considered to be a result 
of the chaotic nature of the microscopic dynamics, accord- 
ing to which nearby initial conditions separate exponentially 
fast due to the convex nature of the obstacles. Thus a cloud 
of (non-interacting) particles in this Lorentz gas spreads out 
over time in a way similar to that of solutions of the diffusion 
equation, 

([x(f)-x(0)]2)~4Df, (1) 

where x(f ) denotes the position of a tracer at time t, with ini- 
tial position x(0), and the mean squared displacement is com- 
puted as an average (•) over many realizations of this process. 
The diffusion coefficient, D, is a constant which depends on 
the geometrical parameters of the system, i.e., the underlying 
microscopic dynamics. 

The diffusion coefficient summarizes the macroscopic be- 
havior of the system while capturing the microscopic prop- 
erties of the dynamics that lead to it. A central question in 
deterministic diffusion is to understand how this dependence 
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on the geometrical parameters comes about. This has been ad- 
dressed in particular by Machta and Zwanzig fS], who showed 
that in the limit where the obstacles are close together, the mo- 
tion reduces to a stochastic Bernoulli-type hopping process — 
a random walk — ^between "traps". By calculating the diffu- 
sion coefficient of this random walk, they were able to obtain 
a reasonable agreement with the numerically-measured value 
of the diffusion coefficient. 

The approach of Machta and Zwanzig was extended heuris- 
tically by Klages and Dellago |T|, by including important 
physical effects not taken into account in the simple random- 
walk picture, namely a possibly non-isotropic probability of 
changing directions, and of crossing two traps at once. Klages 
and Korabel 1 8 1 then provided an alternate approach, in which 
they employed a Green-Kubo expansion of the diffusion co- 
efficient to obtain a series of increasingly accurate approx- 
imations, based on numerically-calculated multi-step transi- 
tion probabilities. In one particular Lorentz gas model, they 
showed that their results are in good agreement with this ex- 
pansion, see also 0]. Nonetheless, as we emphasize below, 
the physical motivation, and indeed the physical meaning, of 
this approach, are not clear. 

The purpose of this paper is to show that in fact the correct 
expansion beyond the Machta-Zwanzig approximation is to 
incorporate this type of correction in the framework of persis- 
tent random walks. In other words, to be consistent, memory 
effects of a given length, whether one or several steps, must 
be accounted for through their contribution at all orders in the 
Green-Kubo formula relating the diffusion coefficient to the 
velocity auto-correlations. This is physically strongly moti- 
vated, and provides the correct way of incorporating correla- 
tion effects, in principle, of any finite order. 

In the usual periodic Lorentz gas on a triangular lattice con- 
sidered in [81, the model is sufficiently isotropic that higher or- 
der contributions are small and can be safely neglected. How- 
ever, when the correlation effects are very strong, this is no 
longer the case. We introduce a billiard model with this prop- 
erty and show that, whereas a Green-Kubo-type expansion 
fails except very close to the Machta-Zwanzig limiting case, 
the approximation based on a first-order persistent random 
walk is in reasonable agreement with the data. By further con- 




FIG. 1: Periodic Lorentz gas on a triangular lattice. A typical tra- 
jectory is shown, which starts at the upper right disk in the initial 
cell — marked by the highlighted triangle — and moves across the ta- 
ble, performing a diffusive motion. 



sidering memory effects up to two successive steps, we find 
that the agreement between the numerically-measured diffu- 
sion coefficient of the billiard table and that of the second- 
order persistent random walk extends to an appreciably larger 
range of parameters. 



II. PERIODIC LORENTZ GAS ON A TRIANGULAR 
LATTICE 

Consider the periodic Lorentz gas on a triangular lattice, 
shown in Fig. [T| The centers of three nearby disks are iden- 
tified as the vertices of equilateral triangles which, in our no- 
tation, will be taken to be of unit side length. Denoting by p 
the radius of the disks, we let 5 = 1 — 2p denote the spacing 
between disks. When 5 = 0, the triangles form closed traps 
from which the tracer particles cannot escape. If, however, 
< 5 <C 1 , then we expect the particles to remain inside the 
cell for a long time before they can escape to another cell. 
This argument can be made precise using ergodic theory 
Given a tracer of unit velocity, the mean trapping time T is 
given in terms of the ratio of the cell area to the lengths of the 
holes by L?| 

^/3/4-7^pV2 V3/4- Ttjl - Sf/S 

T=K = K ^-^^ . (/) 
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Assuming that this time is longer than the typical decay of 
correlations 1 18 1, Machta and Zwanzig |6 1 argued that the dif- 
fusion coefficient of the Lorentz gas can be approximated by a 
memory-less random walk (called the "short-memory approx- 
imation" in flOl ). 



where, in our notation, the lattice spacing t = 1/ ^/2>. 

Taking further account of memory effects, Klages & Ko- 
rabel |[8| noted that the Machta-Zwanzig approximation ([3]l 
is the zeroth order expansion of a series given by the Green- 
Kubo formula for the diffusion coefficient: 



D = Dmz 1 



-21 

k=\ 



VO ■ V*:) 



(4) 



where v^^ is the jump vector ("velocity") between traps on the 
fcth step, and (vo • v^^) are auto-correlations of the velocity at 
steps and k. 

The approach taken in |8| was to truncate the expression 
Q at a finite value of k, assuming that all higher-order cor- 
relations are 0. They showed that by numerically calculating 
the terms appearing in this equation, the results evaluated by 
this truncation converged to the numerically-obtained diffu- 
sion coefficient. 

However, this ad hoc truncation has no physical meaning: 
if (vo'Vi) 7^ 0, it is not true that higher-order correlations 
(vo • ^k) vanish. Rather, assuming that the process has mem- 
ory of the previous step alone — which we will refer to as the 
single-step memory approximation — one must compute the 
correlations (vq • Vjt) in a consistent way, and evaluate the dif- 
fusion coefficient (Hh by taking all the A;'s into consideration. 



A. Single-step memory approximation 

The process for which the motion of a particle at step k+\ 
depends explicitly on the state at step k is known as a persis- 
tent or correlated random walk ifTTl [T2l [T3l [T4"|. The tech- 
nique for studying such walks is well developed, and consists 
of treating it as a random walk with internal states, which, in 
this case, describe the direction with which the walker arrives 
at a site. 

Considering a persistent random walk on a honeycomb lat- 
tice, we denote by Pb the conditional probability to return in 
the direction opposite to the current one, to turn right and 
P\ to turn left. In terms of these quantities, the velocity auto- 
correlation is found to be I.15J 



(vo • yk) 



P, + P\ \/3, 
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(5) 



where / = \/—\. In the case of a symmetric walk for which 
= = Ps = ( 1 - fb) /2, the diffusion coefficient (H is 



OlSMA — DmL 



3(1 -Pb) 
l + 3Pb 



(6) 



In comparison, the first order approximation made in fSl is to 
write 



4t' 



(3) 



D 
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l+2(vo-vi)=DMz(2-3Pb), 



(7) 
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which corresponds to the first-order approximation of Eq. (|6]l 
when expanding Disma about the isotropic process for which 
fl, = 1/3. 

B. Two-step memory approximation 

For a persistent process with two-step memory approxima- 
tion, there are nine conditional transition probabiHties, which 



we denote by fbb. Phr^ Phh ^rb> Prr, Prh P\b^ P\r ^nd P]i, where, 
for instance, F[,^ denotes the probabiHty that the tracer first 
moves backwards and then turns right, and similarly for the 
other symbols. Although the corresponding Markov chain in- 
volves a 9 X 9 stochastic matrix, there are symmetries in the 
system which can be exploited to reduce the computations 
to 3 X 3 matrices involving the transition probabilities listed 
above. The computation of the velocity auto-correlation then 
yields US] 



(vo-v.> = (-l)'=^(l 1 l) 



Pbh P\b Prb 

(/)Pbi (pPn (pPri 

(/)2f>b, fPi, ^^P„ 



k-l 




Pbb Plb Prb 
f-Pu ,/,2p^i 
</)fto 0Pk CpPn- 



k-l 




Pi 
P2 
P3 



(8) 

where = exp(2/;r/3) and {pi,p2,P3) are the first three components of the stationary distribution of the Markov chain, which, 
for a left-right symmetric process for which Pn- = fli = Pss, Prb = flb = ^sb and Pri = flr = 1 ~ ^ss — ^sb, read 



Pi = 



P.b 



P2=P3 = 



I -Pbb 



6-6Pbb + 6P,b 



3-3Pbb + 3Psb 
The corresponding diffusion coefficient (j4]) is 

3{l-Pbb){l+I\b-Psb){2-Psb-2Pss) 



£'2SMA = DmZ 



(1 -Pbb + Ab)[nb(7 +Pbb - 8Pss) + 2(1 +Pbb)i^ss -4P2] 



(9) 
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This compares to the second-order approximation following 
the truncation scheme in fS), 
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S + 2(V0-V2), 

5-5Pbb-7Psb + 9PbbPsb 



Dmz 



2-2R 



bb- 



2P, 



(11) 
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We note that this expression is actually different from that 
given in |[8l, where the stationary distribution Q was erro- 
neously assumed to be uniform. 



C. Numerical results 

The transition probabilities of the single- and two-step 
memory approximation random walks can be computed for 
the Lorentz gas by estimating the relative frequencies of the 
corresponding events and taking into consideration the left- 
right symmetry of these transitions. Plugging their values into 
Eqs. 



(|6|) and ( 10 1, we obtain the corresponding coefficients 
and compare them to the diffusion coefficient of the billiard 
calculated from direct numerical simulations of the billiard 
dynamics. These results are shown in Fig. |2] including the 
results of the truncations (|7]) and ( [TT| ). 

In the limit 5 ^ 0, we see that the Machta-Zwanzig ap- 
proximation Q is recovered. Looking at a broader range 
of parameter values, whereas the single-step approximation 
yields a good estimate of the actual diffusion coefficient of 



r 



the Lorentz gas only for values of 5 ^ 10 ^, the extent of the 
range of validity of the two-step approximation is much larger, 
5<0.1. 
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FIG. 2: Numerical computation of the diffusion coefficient of the pe- 
riodic Lorentz gas on a triangular lattice, here divided by the dimen- 
sional factor, Eq. |3|. The lines correspond to the different approx- 
imate results discussed above: (long-dashed, black line) single-step 
memory approximation (j6|; (dot-dashed, red line) first-order trunca- 
tion (jTJ; (solid, magenta line) two-step memory approximation ( |10| l; 
(dashed green) second-order truncation l |l 1| (. 

As seen in the figure, the successive approximations (j6]l and 
(10 1 are slightly better than their respective counterparts (j?]) 
and ( [TT] i. The differences between the results of Eqs. (j6]) and 
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(j7]i on the one hand, and Eqs. ( 10 1 and ( 1 1 1 on the other hand 
are, however, quite small and not everywhere easy to appre- 
ciate. The reason is that the transition probabilities are nearly 
isotropic for all values of 5 in the range of allowed values, viz. 
-\/3/4<5<l/2 (the lower bound corresponds to the finite- 
horizon condition). This fact, which we illustrate in Fig.|3]for 
the transition probabilities of the single-step memory approxi- 
mation, explains the validity of the Klages-Korabel truncation 
scheme in this case. 
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FIG. 3: (Color online) Numerical computation of the transition prob- 
abilities f}, (squares) and (circles) of the single-step memory ap- 
proximation associated to the periodic Lorentz gas on a triangular 
lattice. Similar results were reported in Q. 



III. BILLIARD TABLE ON A SQUARE LATTICE 

In order to better emphasize the validity of our approxima- 
tion scheme over simpler truncation methods, we turn to a 
class of billiard tables such as shown in Fig. |4] which alter- 
nates small and large disks on a square lattice. By inserting 
rigid horizontal and vertical barriers between the small disks, 
with gaps of size 8 in their centers, we introduce a control pa- 
rameter of relevance to the dynamical properties of the model 
which is independent of the other system parameters. How- 
ever large the gaps, the trajectories in these billiards can be 
reconstructed from the trajectories of the same billiard with a 
single unit cell on the torus. 

The geometry of the lattice is such that the distance between 
neighboring disks is equal to the lattice spacing, which we 
take to be unity, £ — I. Given the radii Pi of the large disks 
and Po of the small disks, the trapping time is 



45 



(12) 



Given these two parameters, the Machta-Zwanzig approxima- 
tion is here again given by Eq. ([3]). Note that in the present 
model, Dmz depends linearly on 5, contrary to the Lorentz 
gas discussed in the previous section, for which the area of 
the cells varied with 5. 




FIG. 4: Periodic Lorentz table on a square lattice. A typical trajectory 
is shown, with the initial position marked by a thick dot. We take the 
inner and outer radii to be respectively p; = 0.36^ and po = 0.15£ 
and vary only the size of the gaps. 



A. Single-step memory approximation 

Consider a persistent random walk with single-step mem- 
ory on a square lattice. We denote by Pf, P^-, Pj, and P\, respec- 
tively, the conditional probabilities that the particle proceeds 
in the same direction, turns right, reverses direction, or turns 
left. The velocity auto-correlation is 



1 



(vo-V,) = -{[Pf-Pb-/(i^r-fl)]* 



-[Pf-P^, + i{Pr-Pl)]'}. 

(13) 

Plugging this into (j4]) and assuming a symmetric process such 
that Pr = Pi=Ps^{l-Pf-F\,) /2, we obtain the diffusion 
coefficient 



i'lSMA = Dmz 



This expression compares to 



l-Pf + Pb 



D 



j^j, = 1 + 2 (vo • vi ) = Dmz(1 + 2Pf - 2Pb) , 



(14) 



(15) 



which is the first-order approximation of Eq. ( 14 1 when ex 



panding Disma about the isotropic process for which Pf 
Pi, = 1/4. 



B. Two-step memory approximation 

Applying the same procedure to the persistent random walk 
with two-step memory, we have 16 conditional transition 
probabilities, in terms of which it is possible to write the ve- 
locity auto-correlation in the compact form 1. 15 J 
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(vo-v,)=2(l 1 1 1 



^'ff Plf Pbt Prf 
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-Pfb -Plh -Pbb -Prb 
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(16) 



where the p,'s are the first four components of the stationary distribution of this process, which, assuming a left-right symmetric 
process, have the expressions 

„, ^ PbfP,b + P.f-PbbP,f 

^1 4( 1 - Pff + Psb - PffPsb + Pbf{ -Pfb + Psb ) + fl,b ( - 1 + Pff - Psf ) + Psf + PfbPsf ) ' 



P2 



P3 = 



P4 



l-^b-fjpfPfb-Pff + ^bPff 

8(1 - Pff + P,b - PffPsb + Pbfi-Pfb + P,b)+Pbb{-l+Pfl- Psf) + Psf + PfbPsf) ' 

Psb-PffPsb + PfbPsf 

4(1 - Pff + nb - PffPsb + Pbf (-^fb + Psb)+Pbb{-l+Pff- Psf) + Psf + PfbPsf) ' 

1-fbb-fbfffb-fff+fbbfff 

8( 1 - Pff + Psb - PffPsb + Pbf{-Pfb + Psb)+Pbb{-1+ Pff - Psf) + Psf + PfbPsf) ■ 



(17) 



The diffusion coefficient of this process may then be ob- 
tained by substituting Eqs. ([T6]l-([T7]i into Eq. (|4]) and summing 
over k. We will however not write down its lengthy explicit 
expression, referring the reader instead to II 131 . 



Let us also notice that Eqs. ( 16 1-( 17 1 can be used to write 
down the corresponding second-order approximation in JS), 
here properly taking into account the stationary distribution. 
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l+2(vo-vi)+2(vo-V2)-Z)yi + 2(vo-V2) . (18) 



C. Numerical results 

The transition probabilities of the random walks with 
single- and two-step memory approximation can be computed 
numerically for the billiard table by estimating the relative fre- 
quencies of the corresponding events and taking into account 
the left-right symmetry of these transitions, as above. Plug- 
ging their values into Eqs. ( 14 1 and ( 16 1, we obtain the cor- 



responding coefficients and compare them to the numerically- 
computed diffusion coefficient of the billiard. These results 
are reported in Fig. |5] including the results of the truncations 
^ and ([18]). 

In the limit 5 ^ 0, we again see that the Machta-Zwanzig 
approximation ([3| is recovered. Zooming into the lower range 
of the parameter 5, we see that the single-step approximation 
yields a good estimate of the actual diffusion coefficient of the 
Lorentz gas only for values of 5 2 x 10^^. The extent of the 
range of validity of the two-step approximation, on the other 
hand, is again much larger, 8 < 0.5. 

The other main observation is that the truncated estimates 
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FIG. 5: Numerical computation of the diffusion coefficient of the bil- 
liard table on a square lattice as shown in Fig.|4] here divided by the 
dimensional factor, Eq. The lines correspond to the different ap- 
proximate results discussed above: (long-dashed, black line) single- 
step memory approximation l |14^ ; (dot-dashed, red line) first-order 
truncation ijTsjl; (solid, magenta line) two-step memory approxima- 
tion, obtained from Eqs. |4]( and l|T6j; (dashed, green line) second- 
order truncation ijTS}. 



( 15 1 and ( 18 1 are inaccurate as soon as 5 ^ 0.05. The rea- 
son can be traced to the anisotropy of the hopping processes. 
Figure |6] shows the transition rates of the single-step mem- 
ory random walk. Although the probability of a right or left 
turn remains close to 1/4 throughout the parameter range, 
the backscattering probability starts growing linearly above 
1 /4 with small 5's and saturates near 1 /2 at around 8 = 0.5. 
Correspondingly, the forward-scattering probability decreases 
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and is close to zero at around 5 = 0.5. 
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FIG. 6: (Color online) Numerical computation of the transition prob- 
abilities P^, (squares), P{ (circles) and Ps (diamonds) of the single-step 
memory approximation associated to the billiard table on a square 
lattice. These rates reflect the anisotropy of the process. 

Looking at the transition probabilities of the two-step mem- 
ory process, shown in Fig.[7j we notice the differences among 
these probabilities, for instance comparing f^b, Pfb and Psb, as 
well as between these probabilities and that of the single-step 
memory process, in our example P\,. These differences jus- 
tify the necessity of resorting to the two-step memory process 
over the single-step process. 

IV. CONCLUSIONS 

The diffusion coefficients of deterministic systems with 
rapid decay of correlations can be well approximated by that 
of correlated walks, where a walker's transition probabilities 
are determined according to its motion over the last few steps. 

Billiards provide good, physically motivated, examples of 
such systems. The Machta-Zwanzig dimensional prediction 
(l6l, according to which the diffusion coefficient is approxi- 
mated by the ratio between the distance between traps squared 



and the trapping time, provides a gross estimate of this quan- 
tity. However, the importance of memory effects in the de- 
terministic diffusion of tracer particles is apparent as soon as 
one moves away from the limit where the trapping times are 
infinite. 

Truncation schemes based on the Green-Kubo formula, 
such as considered in fT/S], may provide accurate results for 
models with little anisotropy, but they are physically inconsis- 
tent: given a hopping process with finite memory effects, ve- 
locity auto-correlations of all orders yield non-vanishing con- 
tributions to the Green-Kubo formula. 

This is particularly clear where anisotropics come into play. 
Estimates of the diffusion coefficients based on persistent ran- 
dom walks, however, do provide accurate results where the 
truncation schemes breakdown. 

It will be interesting to find out how these results trans- 
pose to models where disorder is present, such as with tagged- 
particle diffusion in interacting particle systems. Dimensional 
predictions similar to the Machta-Zwanzig one also appeared 
recently in the context of models of heat conduction llT6l [iTl . 
Estimating the deviations of the heat conductivities of these 
models from dimensional predictions remains an open prob- 
lem. 
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